Tt>L ~J(p~/C)‘5£,y 


NASA TECHNICAL NOTE 

1 


evi 

oo 


L). S= All 


FORCE 







FAILURE RATE ANALYSIS OF 
GODDARD SPACE FLIGHT CENTER 
SPACECRAFT PERFORMANCE 
DURING ORBITAL LIFE 


H. P. Norris and A. R. Timmins 

Goddard Space Flight Center 
Greenbelt, Md. 20771 



NATIONAL AERONAUTICS AND SPACE ADMINISTRATION • WASHINGTON, D. C. • JULY 1976 



Page intentionally left blank 


Page intentionally left blank 



CONTENTS 


INTRODUCTION 

DATA BASE 

TIME DISTRIBUTION OF MALFUNCTIONS 

LIMITATIONS ON DATA 

DUANE GROWTH MODEL 

WEIBULL RELIABILITY ANALYSIS 
SPACE VERSUS TEST FAILURE . . . . 

COMPONENT RELIABILITY 

CONCLUSIONS 

REFERENCES 


Page 


1 

2 

2 

2 

4 

6 

9 

10 

11 

13 


lU 



FAILURE RATE ANALYSIS OF GODDARD SPACE FLIGHT 
CENTER SPACECRAFT PERFORMANCE DURING ORBITAL LIFE 


H. P. Norris and A. R. Timmins 

Goddard Space Flight Center 
Greenbelt, Maryland 

INTRODUCTION 

The space performance of Goddard Space Flight Center spacecraft launched in the 1960-1970 
decade has been tabulated by type and criticality of defects, contribution of redundancy to 
space performance, comparison of defect population in the system test program with that m 
space, and by the time distribution of malfunctions in space (References 1, 2, and 3). These 
data have been used in the present study which- presents results of analyses using both 
Duane (Reference 4) and Weibull (Reference 5) growth models, provides failure rate values 
which may be useful for estimating future space performance, and for comparing past, 
present, and future space performance; and examines the failure rate data from the thermal- 
vacuum system tests and relates these rates to those experienced in space. 

Reliability predictions of space performance based on the number and failure rates of piece 
parts in a spacecraft have not been adequate in the past and, in general, led to predictions 
which were unduly pessimistic. These assessments generally have used an exponential dis- 
tribution with a constant failure rate for calculating space reliability. Also, experience has 
shown that the majority of space malfunctions are not catastrophic to the mission, nor even 
to the component (such as an instrument or a transmitter). 

Piece parts are not used as the basis of the study reported here. Some of the results are on 
the basis of failures per spacecraft, and show a consistent decrease in failure rate with time 
in space. However, most of the results are on the basis of failures per component per day. 

A component as used in this study performs a definable function. Examples of spacecraft 
components are: transmitter, tape recorder, experiments, etc. The use of components as a 
base of reference makes the results more useful m comparing the performance of an individual 
spacecraft with computed average performance. Moreover, the results can be used to estimate 
future performance for spacecraft of differing complexities. 

Results were presented in 1968 of a comprehensive survey (Reference 6) and study of the 
space performance from 225 launches (prior to 1967) which included both NASA and mili- 
tary programs [Additional data were compiled in 1971 (Reference 7) and 1972 (Reference 8)] . 
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One part of these studies provides failure rate estimates for piece parts, components, and sub- 
systems. These estimates are usable as the constant failure rates needed when calculating 
rehabihty, assuming an exponential relationship. The present study deals only with com- 
ponent failure rates. The failure rates are averages of all the components of a spacecraft and 
are presented as a function of time. 

DATA BASE 

The data for this study are taken from the performance of 57 unmanned spacecraft developed 
under GSFC management. The spacecraft included four meteorological spacecraft, six 
applications technology spacecraft, twelve operational weather spacecraft, two astronomical 
observatones, six geophysical observatories, six solar observatories, seven interplanetary 
monitoring platforms, and fourteen miscellaneous scientific missions. 

The experiments and subsystems for these spacecraft have been provided by various organi- 
zations, including GSFC, other government agencies, universities, and aerospace companies. 
Eighteen of the spacecraft received a full system test at GSFC, and the remaining 39 received 
a full system test at the contractor’s facility 

The terms “malfunction” and “failure” are frequently encountered when discussing space- 
craft performance. A malfunction is defined as any performance outside specified limits 
and can be either a failure or a problem. A failure is the loss of operation of any function, 
part, component, or subsystem, whether or not redundancy permitted a recovery of opera- 
tion. A problem is any substandard performance or partial loss of function which is believed 
to be temporary or not of sufficient gravity to be classed a failure. 

TIME DISTRIBUTION OF MALFUNCTIONS 

Figure 1 shows the time distribution (in 30-day increments) of the malfunctions and failures 
documented for the 57 GSFC spacecraft (Reference 1). Figure 2 presents the space mal- 
functions (and, separately, the space failures) in a cumulative fashion for the first 3 years 
m space. The total number of malfunctions for the 3 years was 438, of which 239 were 
classified as failures. Only 1 1 malfunctions were documented beyond 3 years. The analy- 
ses reported herein are based on the data up to 3 years. 

LIMITATIONS ON DATA 

The data base for this report is comprehensive and representative, but some limitations need 
to be kept in mind when assessing or using the results. The data are necessarily based on re- 
ported malfunctions. Some differences between reported and actual malfunctions can be 
expected, based on the wide spectrum of mdividuals responsible for reporting a malfunction. 
Although there is no way to quantify the difference, it is thought to be small. For mstance, 
the number of documented first-day space malfunctions for the spacecraft of this study has 
increased about 15 percent since the 1971 analysis (Reference 3) was published. This situa- 
tion emphasizes the fact that some malfunction data may be subjective and undergo change 
with later documentation. 
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Figure 1 . Time distribution of space malfunctions from 57 GSFC spacecraft. 


The cases of radio frequency interference, including spurious commands, have been omitted 
from this study This specialized problem has varied widely between satellites, orbits, loca- 
tion and power of ground-based energy sources, and command systems. The omission is not 
intended to minimize the importance of this type of malfunction. For instance, an early 
spacecraft had 400 anomalous command states dunng the first year in space Inclusion of 
such data would have obscured the findings of this study. Because of continuing problems 
m this field, radio frequency interference testing of spacecraft before launch is as important 
now as It was in the early days of the space program. 



Figure 2. Relationship of space malfunctions and time 
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Ground station problems comprise another category not included m this study, smce m the 
main, these are temporary equipment- or personnel-related events. When a malfunction was 
definitely ascribed to a spacecraft, it was then included as part of this study. 


DUANE GROWTH MODEL 

The Duane growth model (Reference 4) was shown to fit failure data taken during a 
reliability improvement program. It has been used for controlling and predicting reliability 
of diverse kinds of electrical and mechanical devices. Duane observed that the cumulative 
operating hours on a log-log plot gave a straight line with the relationship given by 

F 

= — = KT^ 

i, /p 

where = cumulative failure rate, K = a constant given by the Y intercept at T 
test hours, F = failures during T, and a = slope of the line or growth rate 

The cumulative failure rate for the space data was determined using the above relationship 
where F was the cumulative failures, and T was the cumulative spacecraft days. A log-log 
plot of the cumulative failure rate versus time in space is shown in Figure 3. The two equa- 
tions shown fit the observed data very well for the time period of 1 to 30 days and 31 to 300 
days. The cumulative failure rate is in units of failures per spacecraft per day. It is significant 
to note that most of the failures did not result in the loss of a spacecraft. No attempt is made 
at this point to account for the comparative complexity of a spacecraft. 

The Duane growth equation! 1) was modified to improve the utility of the data by including 
the average number of components per spacecraft. This was done by lettmg K = NK^^ , where 


( 1 ) 

= 1 , T = total 
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Figure 3 Cumulative failure rates in space. 
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N is the average number of components per spacecraft, and is equal to a unit constant. 
Stated in other words, = K/N. Thus, 

F 

= NK 

i, O 


and finally 


^2 


F 

NT 


= K T-“ 


( 2 ) 


where X now becomes a failure rate with respect to components, rather than to the spacecraft. 


One other change is made to the equation by replacing T with (T + 7 ), where 7 has the 
same function as the “location parameter” customarily used to fit a Weibull function to 
disparate data. Essentially, this parameter adjusts the data time base to coincide with the 
“aging time” of the reliability growth model. The final equation then, in a more general form, 
becomes 


X 


2 


F 

N(T+7) 


= K^(T + 7)-“ 


(3) 


To be consistent with the units of the reported space failures or malfunctions, N was chosen 
to be the average number of components per spacecraft As previously defined, a “com- 
ponent” is a unit within a spacecraft that performs a function, such as a transmitter, receiver, 
voltage converter, etc. A component count was made, or where necessary, the number was es- 
timated for each of the 57 spacecraft in the sample. This resulted in a number of components 
per spacecraft ranging from 30 to 1 14, with an average of 65. This average value was sub- 
sequently used to normalize the failure data, and for determining average failure rates. 

The cumulative failure rate was again computed using first, equation 2, and agam, equation 
3. The results are plotted in figure 4. The upper plot exhibits the same apparent double 
slope as seen previously in figure 3 ; however, the lower plot, using a location parameter, 7 , 
equal to 3, shows the log-log relationship of with total time to be essentially linear. The 
slope, a, is the same for both plots for large values of time T. The solid line through the 
corrected plot is a least squares fit, yielding the following estimates for the parameters in 
equation 3 

1 =0.00918 

O 

7 (est.) = 3 days 

a = 0.689 (scalar) 

The caret (a) denotes a least squares estimated value. 
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Figure 4. Cumulative failure rate versus time in space for GSFC spacecraft components 


WEIBULL RELIABILITY ANALYSIS 

Crow (Reference 5) has shown that the Weibull failure rate, Xj3 , is equivalent to the failure 
rate, (1 - a) , developed for the Duane growth model. This equivalence is useful in that 
It gives two independent techniques for computing the parameters in the failure rate func- 
tion, particularly with respect to the slope, a, which is related to j3 by |3 = 1 - a. 

The total component count per spacecraft is not necessary m the Duane growth analysis 
for the determination of a, as evidenced by figures 3 and 4 For the graphic solution of the 
Weibull parameters, |3 and X, however, the sample size, N, is necessary and is used to plot 
the log of (N/N-F) versus time on log-log paper as shown in figure 5. The basic plot shows 
an initial curvature that is corrected to a linear relationship by adding a location parameter, 

7 , equal to 3, to the space time base, as was done previously to the modified Duane plot. 

The corrected data points fitted with a least squares solution for the straight line yield 


A 

K 

o 

= 0.00917 

A 


P 

= 0316 

A , A 
a = 1 -p 

= 0.684 (scalar) 

7 (est.) 

= 3 days 
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Figure 5. GSFC spacecraft component failure analysis (space data). 


The agreement between these values and those from the Duane model indicate the close re- 
lationship between the two models, and also confirms that the component count average per 
spacecraft (65) is compatible with the space failure data 

Figure 6 is a plot of the cumulative component failure distribution, with the actual space 
failure count shown by the data points. The solid line represents either the modified Duane 
growth or the Weibull model (differences in the two models are not distinguishable). The 
solid line shows a good fit with the data for about 2 years in space Beyond this time, the 
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Figure 6 Time history of GSFC spacecraft component failures. 
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model projects a greater accumulation of failures than has been recorded. This difference is 
also reflected in figure 7, where X. = (T + 7 )^'* , the WeibuU instantaneous failure rate 
function is superimposed on the computed averages of the instantaneous failure rates, X , 
derived from the data. The average failure rate, X^, from 540 to 1000 days is consistently 
lower than the Weibull function in this range, although the trend appears to be converging 
at the end. Figure 7 demonstrates that the instantaneous failure rate is not constant, but 
decreases with time in space. A plausible explanation for this decreasing trend is that the 
data sample includes a wide variety of components with a range of failure rates as depicted. 
This, of course, is the situation that prevails in any complex system. 



TIME IN SPACE (T+3) DAYS 

Figure 7. GSFC spacecraft component instantaneous failure rate. 


Fortunately, all component failures do not result in a loss of the total spacecraft; and further, 
their effect on carrying out the spacecraft mission vanes m significance from a minor to a 
major degree (References 1 and 6 ). One study (Reference 1) indicates that only about 10 
percent of the component failures are critical to the spacecraft mission. Another study 
(Reference 6 ) appears to confirm this conclusion and presents a rather comprehensive analy- 
sis of the severity of each failure. The authors identify failure rates of each class of com- 
ponents without regard to aging effects (constant failure rates). The approach in the present 
study has been to show an average component failure rate for a composite spacecraft as a 
function of time. It is interesting to note that the range of failure rates in both cases are 
comparable. 

With a location parameter, 7 = 3, the mathematical model generates a first-day failure rate 
equal to one-fourth the average failure rate derived from the actual first-day data. This im- 
plies that the total of first-day failures was higher than normally expected by a factor of four. 
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assuming an environmental stress equivalent to that experienced m space beyond the first 
day. Since some spacecraft components are not turned on immediately after the launch 
phase, it is not possible to account for all failures until at least a day has passed. Accordingly, 
it would appear more appropriate, at least for the unmanned spacecraft programs, to meas- 
ure the intensity of the launch environment as a function of its effect on the first day cumu- 
lative failure rate, instead of the usual consideration where a K-factor is used only for the 
time interval of launch vehicle operation. With respect to this analysis, then, it may be con- 
cluded that a K-factor of four is representative of the intensity of the launch environment 
averaged over the first day m space 

SPACE VERSUS TEST FAILURE 

A relationship between spacecraft performance during the test phase, and its performance 
during orbital life would be helpful in the evaluation of environmental test effectiveness. It 
could be helpful in refining the test philosophy that has been developed for more than a 
decade 

Thermal-vacuum system test data from 39 spacecraft were evaluated m the same manner as 
that used for the 57 spacecraft m space After the data were normalized to account for time 



Figure 8. GSFC spacecraft component failure rate during thermal-vacuum tests. 

truncated tests (failed units were replaced, and all units operated when testing was complete) 
the cumulative failure rate was plotted as before (figure 8). A time correction factor, 7, of 
minus 0.8 days was applied, and a reasonable least squares fit was obtamed yielding the 
following parameters 

7 (est.) = -0.8 days 
K = 0.01552 

O 

a = 0.434 


9 


The reliability growth slope, a, is still present, but at a reduced rate in comparison to that ex- 
perienced in space. The ratio of a to was 0.43/0.69, or approximately 0.62. 

Having obtained the parameters for the cumulative failure rate function, the next step was to 
compute the instantaneous failure rate for comparison with that m space. Here agam the 
Weibull function, X = K)3 (T + 7 /"* , was used. However, for a more graphic presentation, the 
inverse of X, was computed, thus yielding the mean time between failures (MTBF), which 
when plotted, shows the rehability growth trend of the spacecraft during the test phase. This 
IS shown in figure 9, along with the MTBF derived from the Weibull function, X , from space 
data. The MTBF at the end of the test program was compared to the space model at T = 1 
day. This would approximate the condition somewhere durmg or immediately after the 
launch phase in real time. At this point, the mstantaneous MTBF appears to be in reasonable 
agreement with the terminal value developed from test. 

UJ 



Figure 9 Comparison of component MTBF during thermal-vacuum test and 
first 36 days in space. 


COMPONENT RELIABILITY 

The average component reliability for 3 years in space is shown in figure 10. The reli- 
ability was computed using Weibull reliability function 


R (t) = e -y (T + 3/ 


The terminal value of the component failure rate (X = 0.00285) from the thermal-vacuum 
test, and the value of )3 (j3 = 0.31 1) denved from space data, were used in this solution. The 
resulting curve is coincident with the plot from the actual space data. The reliability that 
would have resulted if the terminal component failure rate (0.00285) m test had remained 
constant in space, and the exponential relationship of R(t) = e'^* used are shown m figure 10. 
Reliability values in this case are dramatically lower than the reliability values from the ac- 
tual space data. 
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Figure 10. GSFC component reliability in space. 

CONCLUSIONS 

The results of this study, in addition to the corollary studies of references 1 and 2, form the 
basis for the following conclusions on the space performance of GSFC spacecraft for the era 
of 1960 through 1970. 

• The average component failure rate in space decreases with time for the entire 
three-year penod covered by this study. This trend can be represented with accept- 
able accuracy by either the Weibull distnbution or the Duane Growth models. 

• First-day failure rates are higher than would be indicated by either the Duane or 
Weibull growth curve by a ratio of 4' 1 . 

• The average component failure rate during spacecraft thermal-vacuum testing 
exhibits a reliability growth trend The termmation failure rate is generally 
similar to initial failure rates experienced in orbit, although the first day failure 
rate may be as much as four times greater due to the increased severity of the 
launch environment. 

• Early component failures do not usually result in the loss of a spacecraft. 

Goddaid Space Flight Center 

National Aeronautics and Space Administration 

Greenbelt, Maryland May 1976 
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